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We calculate the granular quantizing noise for a delta modulator that 
has unequal positive and negative step sizes. The asymmetry leads to a 
highly colored noise spectrum. We perform this calculation by adding a 
ramp function of lime to the inpxd of a symmetrical coder. The resulting 
formulas can also be used for uniform DPCM and PCM coders. The 
idle-channel spectrum consists of discrete lines which scatter somewhat 
irregularly in amplitude and frequency; they can be regarded as the result 
of sampling (aliasing) a sawtooth wave. These lines are phase-modulated 
by a coder input. For a sinusoidal input, discrete side frequencies are 
produced which again have an irregular progression of amplitudes. Gaus- 
sian inputs lead to gaussian line shapes; the lines broaden as input power 
is increased. A totally while spectrum (as is often assumed in connection 
with delta-modulation-system considerations) cannot be attained, however, 
before the onset of slope overload. We give a numerical example that uses 
a coder suitable for telephone applications. One can see that step asym- 
metry can be very advantageous in attaining low noise. 

I. INTRODUCTION 

While Laane and Murphy 1 were investigating the encoding of speech 
using delta modulation (AM) 2 it became apparent to us that existing 
theories of granular quantizing noise 3,4 were seriously deficient; they 
did not take into account, except in a very elementary way, the asym- 
metry of the positive and negative integrator step sizes. This work in- 
tends to correct this deficiency. 

Figure 1 is a block diagram of a AM coder-decoder. An input signal 
is compared with a locally reconstructed version of itself and the 
differential, or error, is quantized into a one-bit code, transmitted, and 
integrated at a receiver to recover the original signal. Quantizing 
noise is produced by the coding process and is also recovered at the 
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Fig. 1 — Delta-modulation coder plus decoder (codec). 

receiver; this noise is the subject of this paper. We limit our considera- 
tion to single-integration systems. 

In the past, considerations of AM noise have been broken into two 
distinct areas: calculation of quantizing noise accompanying a typical 
signal, 3 and calculation of idle-channel (zero-input-signal) noise. 4 As 
Fig. 2 shows, there is no idle-channel noise for a coder in which the 
plus and minus quanta (steps) fed to the integrator are exactly equal 
in magnitude. The integrator output spectrum contains only the out- 
of-signal-band Nyquist frequency, f N (one half the sampling fre- 
quency, f s ) and its harmonics. In any real coder, however, it is 
impossible to balance the plus and minus steps perfectly, with the re- 
sult that the output contains occasional double-plus (or double-minus) 
steps, as Fig. 3 shows. In general, this waveform has signal-band com- 
ponents. Wang calculated the noise for this case but his results, while 
adequate as far as they go, are incomplete and nonrigorous. 4 Van de 
Weg's calculation of noise in the presence of signal was for an equal- 
step (symmetrical) coder. 3 We do the calculation for an unequal- 



< 



TIME- 



Fig. 2 — Integrator-output wave from a symmetrical (equal-step-size) coder. 
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Fig. 3 — Integrator-output wave from an asymmetrical (unequal-step-size) 
coder, shown with | <r + | > \tr-\. 

step (asymmetrical) coder and show that there are significant differ- 
ences. 

In much of the literature on delta modulators, where noise is treated 
casually, the assumption is made that the total average noise power 
is more or less uniformly distributed in the band from zero frequency 
to the Nyquist frequency. This assumption is a very good approxima- 
tion for multibit PCM and DPCM but, as we show, can lead to 
colossal errors for AM. 

Results presented for gaussian input are in terms of time-averaged 
noise power. In this form they are directly useful for speech systems 
and typical data systems but are of more limited value for video 
systems, where details of the waveform are perceived. 

In Sections II and III, we set up the method of attacking the prob- 
lem. Then in Section IV we treat zero input (the idle channel), in 
Section V a sinusoidal input, and in Section VI a broadband gaussian 
input. The appendixes contain various mathematical developments 
necessary for logical completeness but not important to the reader 
interested in engineering understanding and application of the main 
results (with the possible exception of Appendix D). 



II. QUANTIZING RULES 

The function of the coder (Fig. 1) is, at each clock time or sampling 
instant, to add a positive step (<r+) to the integrator output {q) if this 
output is less than the signal input (y) or to add a negative step (a_) 
if the output is greater than the input. If the integrator has instanta- 
neous response and infinite time constant, the output is a sequence of 
rectangular pulses, as in Figs. 2 and 3. 

If y n is the value of the input at the nth sampling instant, and q» 
is the output value just before this instant, the operation can be sum- 
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marized: 



Vn - q n 
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q n + <r+ 
q n + <r- 



As we mentioned, it is not possible to make the magnitudes of tr+ 
and ct_ exactly equal in a real coder. Let us therefore define 

o- + = a + e, cr_ = — a + e, (1) 

where <x, the average step size, is a positive quantity. The coder opera- 
tion can then be summarized in a single equation: 

g n+ i = q n + <r Sgn (y„ - q n ) + «• (2) 

We are actually interested in the error, or noise, x = q — y, which 
accompanies the reconstructed signal. (Appendix A shows that x is 
usually uncorrected with y and is therefore noise under any circum- 
stances.) Substituting for q in equation (2) gives the noise as a function 
of the input: 

.r n+l — x„ + o-sgn x„ = —y n+ i + y n + e (3) 

= -fo, + , ~ (n+ l)e]+ [yn-ne] (4) 

- -¥i« + V'n . (5) 

Thus we are led to a crucial principle: The noise output of an asym- 
metrical (e 5* 0) AM coder can be calculated as the noise output of a 
symmetrical (e = 0) coder, if the input is taken as the actual input plus 
an appropriate ramp or staircase function of time. 

If equation (5) is summed from t = — °o to just before the nth in- 
stant [assuming x(— <=) = y{— «) = 0], 

B- 1 

x n + o" £ sgn x, = -?/,' (6) 

or 

q'„ = —a X) s S n x < • (7) 

,=-oo 

The resulting summation in equation (7) must be an integer alternat- 
ing between odd and even values as a function of n. We can, without 
loss of generality, take it even for even n. [In equation (11) we include 
an arbitrary initial value of amplitude for the ramp; this covers the 
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possibility that the odd-even assumption is consequential.] If we assume 
that the coder does not go into slope overload (that is the input slope 
stays between the limits <t + /t, and <t-/t.), then q'Ja is the nearest odd 
integer to (y'„ + e)/<r for the odd sampling instants and the nearest 
even integer for the even instants. y' n + e appears, rather than y'„ , 
because the error must range from a + eto— a -\- t rather than from 
+<r to — <r. The effect of this added e is simply that the coder transmits 
a dc level of e in addition to other signals and noise. Since AM systems 
normally suppress dc, as is mentioned in Section III in connection 
with other reasons, this added e is dropped in the succeeding mathe- 
matical development. If it is desired to include it, x — e should be 
substituted for x in what follows. 

We have seen that a AM coder has two quantizing functions which 
alternate in time. Figures 4 and 5 show these functions; both the input 
and output are normalized to a. 

q' (y) and q' e (y) were called E(y) and 0(y) by van de Weg who cast 
them into contour-integral form and used them directly. 3 We prefer 
to follow the suggestion of Rice and use the error functions, x{y), 
also shown in Figs. 4 and 5. 5 These functions, periodic in y, are con- 
veniently represented by their Fourier series: 

x t = £ A-, exp (irilg') , (8) 



and 



x = EC-iy-TjexpfcrtV) ( 9 ) 



where (/ m y' la. For a AM coder then, 

x n = E(-l)'"-^exp(«7 ff (10) 

= E ^j exp [iril(n + gi)] (11) 

- Z "^ exp M[tfo + (I - *)n +<?„]] , (12) 

where we have introduced 

g n = ^, » = *, *„ = -• (13) 

a <t a 

The last part of equation (13) takes into account an arbitrary initial 
amplitude for the ramp. 
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Fig. 4 — Quantizing and error functions for odd sampling intervals. 

There is actually nothing in equation (12) which constrains the 
change in integrator output to be equal to one step per sampling 
interval. Indeed, the quantizing functions in Figs. 4 and 5 are perfectly 
valid for uniform DPCM systems where changes ±o-, ±3<r, ■ • • , 
±(2iV — l)<r are allowed. Thus the formulas developed in this paper 
can be used for DPCM (and PCM — see Appendix B) with the provision 
that they are useful for input signals with up to 2N — 1 times the 
maximum slope of the AM system. This provision is not trivial, how- 
ever; when signals range over many steps per sampling interval the 
errors tend to be uncorrelated, the noise spectrum tends to be white, 
and the structure (important for AM) calculated here is negligible. 

III. NOISE FORMULA 



Results in this paper are given in terms of frequency spectra of 
noise (two-sided unless otherwise identified). It is well known that 
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the spectrum of a pulse sequence can be broken into a factor which 
contains the information about the pulse shape and a factor which 
contains information about the area of each pulse and the periodicity. 
The "shape" factor (called also the "structure" or "aperture" factor) 
depends on the details of the coder circuit response. This factor is 
frequently negligible, because the low pass filter it represents normally 
does not contribute any significant distortion in the signal band. Thus 
we need only consider a 8-function representation of the sampled- 
signal, integrator-output, and noise pulse trains, as did van de Weg. 3 
The noise wave with the proper area for each pulse is 



"(0 = r. 2 .r„ 8(t - tit.), 



(14) 




Fig. 5 — Quantizing and error functions for even sumpling intervals. 
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where t, is the sampling interval (=l//„). If x(t) is defined as a con- 
tinuous wave with samples x n = x(vt,), equation (14) can be written 

"(0 = r.x(0 Z 6U - nr.) (15) 

= x(t) £ exp(27r^/./). (16) 

* — 00 

A convenient form for x(t) is, using equation (12), 



*(0 - Z Zn exp [*il[# + (1 - *)/./ + 0(0] I . (17) 



where 



M - «& (18) 

Combining equations (16) and (17) gives 

"(0 =11 4-, esp Loi» + 2iri ( ?(1 7 tf) + k)f t t + rffrfl)] • (19) 

Thus the noise wave (before filtering by the shape factor) consists of 
a collection of lines of frequency 



each phase-modulated by the input signal through a time-dependent 
angle, *lg(t). These lines are examined in Section IV. 

It is well known that the power spectrum of equation (14), and 
therefore equation (19), is periodic in frequency, /, with period / 8 . 
We can thus concentrate on the band from — ju to /#. Because of the 
aliasing or folding problem, all useful signals lie in this band (or any 
band of width / s ). The total power in (— f N , f N ) is tr/3, which is also 
equal to the mean square error, (x 2 ). Appendix D treats these matters 
explicitly. 

Equation (19) gives the noise generated at the coder, while one is 
ordinarily interested in the noise at a (distant) decoder. Unless the 
decoder has exactly the same step sizes as the coder, the noises are 
different. If the o-'s are different, there is some linear gain or loss in 
the system; signal and noise are affected equally and their ratio, the 
really significant figure of merit, is not affected. If the #'s are different, 
the noises will differ only by a drift or ramp function of time. To get 
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rid of this ramp (and also because it is necessary to damp out the 
effect of errors in transmission) real systems have low-frequency (be- 
low-signal-band) cutoffs, called leaks, built into the integrators. The 
high-frequency cutoffs of the coder and decoder integrators may also 
be different. In the event that these cutoffs affect the signal band 
they can be taken into account as separate factors in determining the 
spectrum. Thus equation (19) can be used to calculate noise at the 
decoder output. 



IV. IDLE-CHANNEL NOISE 



The term "idle-channel noise" is used here as if it were synonymous 
with "zero-input noise." We recognize that this terminology is some- 
what loose, in that an idle channel is actually characterized by a 
thermal or other noise input. Nevertheless, this usage seems established 
in the literature and the distinction is not significant for most cases of 

practical interest. 

Figure 3 shows the integrator output of an asymmetrical coder. An 
approximately sawtooth-shaped wave with peak-to-peak amplitude 
s o- is clearly visible (Wang's "first envelope function"). 4 Other not- 
so-evident sawteeth are also usually present. 

Putting y = into equation (4) , we see that the idle-channel noise 
output of an asymmetrical coder can be calculated as the noise out- 
put of a symmetrical coder with a ramp input. Figure 6 illustrates 
this. The error wave in Fig. 6 is the same as the wave in Fig. 3 ex- 
cept for an inconsequential difference in the pulse shapes. 

The idle-channel output is calculated by setting g = in equa- 
tion (19) : 



(l)=EEl exp \rito + 2tt4 (1 - *) + *W| 



1*0 k 



(20) 



which describes a collection of discrete lines. Figure 7 shows a number 
of these lines; the symmetry of the spectrum about all integral multi- 
ples of fy is apparent. 

For any given value of I, there is only one value of k which leads to 
a line in the Nyquist interval (-/. v , 1 N ). This line, of frequency /,, can 
be defined: Let 

Q(a) = a - N(a) (21) 

where 

N(a) = integer nearest a. 
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Fig. 6 — Input, output, and error waves for a (negative) ramp input to a sym- 
metrica] coder. 



Then 



/, - <*«tf% 



(22) 



Ignoring lines outside the Nyquist interval, and combining terms of 
+ 1 and — I, 



"o,v(0 = Z ^sin (ir/t? + 2tt/,0. 



i-i irl 



(23) 



If we now think of the spectrum as one-sided, we have a collection 
of lines of frequency 

/ = Itfi I (24) 

and power 



p -2£. 

r l — 2 72 

7T L 



(25) 



These lines will subsequently be referred to as "main Hues," "original 
lines," "carriers," or "/-lines" (2-line, 5-line, and so on). 
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Figure 8 is an example of the spectrum, bringing out some of the 
important qualitative features. One can see that the terms for which 
I = 2, 4, and so on, are the components of the sawtooth, of peak-to-peak 
amplitude a and fundamental frequency t?/, , evident in Fig. 3. If we 
choose those values of I which equal aN, where a is a positive integer 
and N is the odd integer nearest 1/tf, we have the components of another 
sawtooth of peak-to-peak amplitude 2a /N ~ 2e and fundamental fre- 
quency |1 — Nd | /./2 (Wang's "second envelope function"). In Fig. 
8, N = 19. 

Notice that either the (N — 2) -line or the (N + 2) -line has a fre- 
quency equal to that of the 2-line minus that of the JV-line and a power 
about equal to that of the iV-line (the 21-line in Fig. 8). This line may 
also be thought of as the fundamental of a sawtooth, as may all lines 
at the lower end of the spectrum. 

There is another interesting way of looking at the idle-channel noise 
spectrum. Recalling equations (15) and (17), it is apparent that v (t) 
can be thought of as the result of sampling, at a rate /, , the wave 



x (t) = E -^7 exp {m7[* + (1 - #)/.<]} 



(26) 



which describes a sawtooth of peak-to-peak amplitude 2<r and funda- 
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Fig. 7 — Example of an idle-channel noise spectrum. All lines for Ul.= 1» 2, 
3, 4, and 12 are given; notice their symmetries. Selected other lines are included 
to show the progressions involved. 
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Fig. 8 — Example of a one-sided idle-channel noise spectrum, for # = 5/96. 
The most powerful 25 lines are shown along with selected others, in particular 
the harmonics of the 17-line, 19-line, and 21-line. These and the 2-line plus its 
harmonics make up sawtooth waves. 

mental frequency (1 — &)f N . In Fig. 9 this sawtooth is superimposed 
on the wave of Fig. 3. 

All the Z-lines are distinct if # is irrational, which is expected to be 
the normal case. Appendix B treats rational #. 

V. SINUSOIDAL INPUT 

Let us calculate the noise output of a AM coder for a pure sinu- 
soidal input, setting 

g(t) = A sin (2tt/ < + <p), (27) 

where <p is an arbitrary constant phase angle. We put equation (27) 




— -cr + c 



TIME- 



Fig. 9 — Error wave of Fig. 3 with superimposed sawtooth. The heavy dots are 
the sampling points. Section II explains the vertical offset (e). 
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into equation (19) and make use of the Jacobi- Anger formula: 6 

exp [irilA sin (2ir/ f + *>)]- Z Jm(vlA) exp (2irimf t + tmy), (28) 

where the J m arc the Bessel functions of integral order of the first 
kind. The result is 



...» = E Z E 5; /.frtA) 



(^ + *)/. + »/.}}• W 



• exp (7rt7i? + iwrf exp \liri 
If we define 

ft = (ffl^ + fc(Z, «))/. , (30) 

where fc(Z, m) is chosen so that /{ + mf is in the Nyquist interval, we 
can write (for this interval) 

'j»i.(4 =EEt /-OrU) sin 12tt(/; + mf )t + Wtf + m*]. (31) 

Equation (31) describes a collection of lines consisting of the original 
lines of the idle-channel noise spectrum (or their replicas, /, + &/.), 
each with a set of uniformly spaced (±m/ ) satellites. The total power in 
an /-group (all the lines governed by the index I) is constant. JKrrlA) of 
the power remains in the main line; the with satellite gets JlfalA) of the 
total power. From the symmetry of the spectrum one can see that for 
every Z-line satellite which falls outside the Nyquist interval there is a 
corresponding satellite in the Nyquist interval arising from a carrier 
outside the interval. 

The nature of the Bessel function is such that main lines go through 
a series of peaks and nulls as a function of A for a given I, and I for 
a given A. The satellites, in addition, fluctuate in amplitude as a func- 
tion of the index m. As a result, for the typical case of a signal band 
which is a small fraction of the Nyquist interval and for an input 
frequency of the same order as the signal bandwidth, the signal-band 
noise power is determined by relatively few lines and can be expected 
to fluctuate irregularly as a function of input amplitude and frequency. 

J m (z) goes fairly rapidly to zero as a function of m for m > z. 
Thus the full width of an /-group is 

A/ pst 2*lAf a . (32) 
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Fig. 10 — The I = 1 and I = 2 lines of the spectrum of Fig. 7, modulated by a 
sinusoidal input with / ~ /jv/40 and irA = 5. The other lines are omitted for the 
sake of clarity. (The lack of symmetry in this figure, and in Fig. 11, is due to the 
omission of the image groups: I = —1, —2.) Equation (32) gives A/- 

Figure 10 gives an example of the spectrum which attempts to bring 
out the points made above. If / and f a are not rationally related, the 
lines are all distinct. Appendix C treats the case of rational U/U- 



VI. BROADBAND INPUT 

As first discussed by Bennett, the average noise performance of a 
coder in the presence of a broadband input signal is best calculated 
by using an input signal of random phase. 7 This test signal should 
have the same power spectrum as the input signal under consideration. 
Appendix D gives the mathematical manipulations. 

Briefly the procedure is to calculate the noise power spectrum, 
W(f), by finding the Fourier transform of the autocorrelation func- 
tion, R (t) , of the noise wave. The averaging procedure in the defini- 
tion of R(t) is carried out assuming the input, g(t), is a gaussian 
variate. This gives R(t) in terms of the autocorrelation coefficients, 
a*,, and the mean power of the sequence of input samples; we deter- 
mine the a k from the Fourier transform of the input power spectrum, 
[/(/). We show that, under an assumption that usually holds in prac- 
tice, the dependence on £/(/) reduces to a dependence on the rms time 
derivative of the input. A parameter S, which is this time derivative 
normalized to the average maximum slope of the coder, af s , charac- 
terizes the input in the following (equivalent) formulas: 
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W(f) 






*(1 ~ *) 



, (33) 



J^(/) = X 22 -57^ iVl'' g eX P 
._„ 7T MO 



1*0 p=-00 



2 ^ . *(* - *) J_ 
."(iof i /r ' + —2— + p 



(34) 



Terms of different I do not interact in equations (33) and (34); 
therefore, one may use either formula to calculate the power density 
for a given I. Equation (33) converges faster for high values of I; equation 
(34) for low values. The crossover occurs at I tt l/iir^S. 

One can see [most easily from (34)] that the spectrum consists of the 
lines given in Section IV for the idle-channel noise spectrum, each now 
broadened to a gaussian. Notice that some of the power in the wings of 
each gaussian falls outside (— f N , / lV ). Conversely, lines centered outside 
this band have in-band wings. The total in-band power of each Z-group 
is constant. 

One can easily see that the full width of an Z-group is 



A/ = ISf. . 



(35) 



Thus for IS « 1 one has a relatively sharp line, while all groups for 
which IS > 1 sum to a white background. Figure 11 shows the im- 
portant qualitative features of the spectrum. 

As S approaches one, equations (33) and (34) lose their usefulness 
because of the onset of so-called slope-overload noise. (Strictly speaking 
equations (8) and (9) do not apply under overload conditions; but 
because the errors resulting from overload and quantization are prob- 
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Fig. 11 — The I = 1 and I = 2 lines of the spectrum of Fig. 7, modulated by a 
gaussian input with S ~ Vs. The other lines are omitted for the sake of clarity. 
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ably largely uncorrelated, one should be able to calculate them separately 
with reasonable precision.) To give some idea of the effect, we quote 
Protonotarios' signal-to-overload-noise ratios for various input spectra: 
3 to 17 dB for S = 1 and 16 to 31 dB for 8 = i" These values are lower 
limits, and probably poor approximations for high-quality voice sys- 
tems, because the total noise was used. Nevertheless, it seems safe 
to say that the occurrence of slope overload will prohibit inputs strong 
enough to whiten the 1 -group and, usually, the 2-group as well. 

Figure 12 illustrates calculated noise spectra of a coder suitable for 
telephone applications. 1 Notice the enormous differences in power in 
the voice band for different #'s. For # = 0.02 the 2-line, 4-line, and 
6-line centered at 30.88, 61.76, and 92.64 kHz, respectively, can be 
seen. The broad line centered at 3S.6 kHz for # = 0.05 and S = 2" 10 is 
the sum of the 19- and 21-lines. Although the spectra are white for 
S = 2~ 2 in the frequency range shown, they are not independent of S. 
The 2-line is still spreading out and the 1-line is just starting to spread in. 

Figure 13 presents the results of Fig. 12 in the form of noise power 
in dBrnC versus speech input power in dBm. The unit "dBrnC" means 
dB above one picowatt of integrated noise passing through a filter with 
C-message weighting. 9 Briefly, this filter, which weights noise according 
to its subjective effect in a telephone circuit, has a pass band with a 
transmission averaging about —0.5 dB from ~ 800 to FH 2500 Hz; 
the noise bandwidth is fH 2070 Hz. 

The parameter S is turned into speech power as follows: de Jager 
(see p. 447 of Ref. 2) showed that the ratio of the rms slope of the 
average speech spectrum 10 to the rms amplitude is given by 

r = (jQ) « 2tt-800 Hz « 5000 rad per s. (36) 

Thus, speech power is given by 

P., = C^V- (37) 



r 



-)■ 



In Fig. 13, this quantity is plotted in units of dB above 1 mW. The 
structure in Fig. 13 is best interpreted by referring to Fig. 12. 



VII. SUMMARY AND REMARKS 



We have developed a AM quantizing-noise formalism for the case 
of unequal positive and negative integrator step sizes and have given 
the noise spectrum for zero, sinusoidal, and gaussian coder inputs. 
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Fig. 12 — Partial one-sided noise spectra for gaussian inputs with a = 0.4 
mV/d% (12-mV steps in 900Q), j, = 1.544 MHz, and various values of # and S. 
(a) & = 0, (b) & = 0.02, and (c) = 0.05. 
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Fig. 13 — Noise versus average speech power for the coder of Fig. 12. See 
text for explanation of units. The circles are the calculated points; the lines 
are only to connect points of the same parameter. 

In AM systems, as contrasted with multibit PCM and DPCM, 
the signal typically does not change more than a small fraction of a 
step size in one sampling interval. As a result, the sample-to-sample 
errors are strongly correlated and the noise spectrum is highly colored. 
The main contributions of this paper are to point out that the spectral 
distribution of power is strongly dependent on the step unbalance and 
to provide a means of calculating the spectrum precisely. 

A typical AM system has a signal bandwidth very much smaller than 
the Nyquist bandwidth. The consequences of this situation for the 
idle channel (zero input) are best seen by referring to Figs. 7 and S. 
There are extreme system-noise variations depending on whether or not 
the system parameters are such as to bring into the signal band one 
of the stronger spectral lines. The | I \ = 2-line, which has «15 percent 
of the total Nyquist-interval power, is especially important in this 
regard. 

Coder inputs phase-modulate the idle-channel lines; the frequency 
breadth of the sideband structure is proportional to the rms slope 
(roughly, root power times frequency) of the input. Thus, as power is 
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increased, there may be an abrupt increase in noise as the sidebands 
of a strong line come into the signal band. Figure 13 illustrates such 
a situation. 

At very high input powers most of the idle-channel lines are 
broadened to the point where they make an easily calculable white 
contribution to the spectrum. Unfortunately, the most powerful lines 
(| 1 1 = 1 with 61 percent of the Nyquist-interval power, \l\ = 2, and 
so on) can be broadened to whiteness only by inputs powerful enough 
to force the coder into slope overload. It is possible, however, to mini- 
mize noise in a given system by dithering, that is, the deliberate in- 
jection of certain appropriate signals into the coder (including the 
judicious choice of step unbalance). Dithering requires extensive 
treatment and will be the subject of a future paper. 
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APPENDIX A 

Correlation oj Eiror and Input 

The error wave, v(t), consists in general of a part fully correlated 
with the input, y{t), and an uncorrelated part. The uncorrelated part 
is noise in almost any conceivable system; whether the fully cor- 
related part is considered noise or not depends on the use to which the 
system is put. Let us investigate the correlation by forming the cross- 
correlation function of v and g (assuming zero mean for each) : 

RM s lim ^ J[* v {t)g{t + r) dl. (38) 

Inserting equation (19) gives 

RM = £ -^ exp M«? ) lim r= 

• f git + r)e' u ' U) f, exp [sW^S^ + k)f.t\ dt. (39) 

The integral in equation (39) is zero unless g (t) contains components 
locked to the idle-channel-noise frequencies (Section IV) or their 
subharmonics. Thus for typical AM systems 
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R, a (j) = for all r, (40) 

and v{t) is a noise wave under any circumstances. 

This conclusion is not applicable to the case of rational tf, treated 
in Appendix B, where 1(1 — d)/2 + k = for some values of I and 
A;; that is, some of the idle-channel-noise frequencies are zero. The most 
extreme case is that of PCM (tf = 1) where every value of I contributes 
a dc term to the summation in equation (39) and the summation is 
therefore replaced by one. Let us calculate the two parts of v(t) for this 
case. 

It is easy to show that R vg (t) is a maximum for r = and that we 
need consider only instantaneous correlations. This result is physically 
reasonable when one considers that no delay from input to output 
was introduced in the formulation of v(t). If we let ( ) nv stand for 
the integrating- limiting (averaging) process denned in equation (38) 
we can write 

faX» = «>.(0). (41) 

The correlated part of v(t) is ay(t) , where a is a constant for a given 
y(t). The uncorrected part is then v(t) — ay{t), and the condition for 
determining a is 

<(f - ay)y) av = 0, (42) 

or 

(V )av <T(g )av 

Substitution of a specific input waveform into 

<"<7>.v = Z Zn exp (*m )<g(t)e'" gm )~ (44) 

i^o mi 

will show that ay is generally negligible compared with v unless (g 2 ) ax 
< 1; that is, the signal-to-noise ratio is low. This conclusion is quite 
plausible because of the (g 2 )' 1 dependence of a and because the oscilla- 
tory character of the second factor in the averaging bracket in equa- 
tion (44) makes the bracket tend toward zero as g increases. 

For rational values of t? ^ 1, the summation in equation (44) is only 
over multiples of an integer L (as shown in Appendix B) and ay is 
negligible for even smaller values of (g 2 ). L = 2 for the van de Weg 
case, t? = 0. 
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APPENDIX B 

Entional Step Unbalance 

If the fractional step unbalance, t?, is a rational number, the Z-lines 
of Section IV are not all distinct. Indeed, if L is the least positive integer 
for which (L/2)(l — r?) is an integer, it is easy to see from equation 
(22) that 

j l + L = /, and / £ _, = -/, . (45) 

Let us sum up terms of frequency ±/, in equation (23), ignoring for 
the moment the cases I = L and I = L/2 (if it exists). Then 

VOHlW - S v Q+l> L ) *™ W + VL) »° + 27r/ ' /] 

+ t v{L Jl + VL) Sin W " l + VL) ~ *** (46) 
A little manipulation of the indices in the second summation gives 

vomit) = E -rnrVn sin W + '' L)t9 ° + 27r/ ' /] (47) 

= £ vi I i/n ex P I»Wi + W + a^ifl) + c - c -*- < 48 ) 

i»r=.oiri(t + f L) 
From Jolley's series Nos. 534 and 535 it is easily established that 11 

V -^- = 7T csc ate™ 1 "" for < * < 2tt. (49) 

Using this to do the sum in equation (48) , 



.1 

a CSC l -J ir 



von 



■«(0 - — a — ex P 



/J 

2ff CSC I T T 



*^x-T»i+ir»o + 2»/,*j 



+ c.c. (50) 



-=^-^ sin hr ^ - t», + t»o + 2if,lJ , (51) 

where 

L#i = least positive quantity = L& mod 2. (52) 



* By c.c. we mean complex conjugate. 
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The power at / = | fi | is thus 

Iff CSC I y 7r 

P, = jr*-*- (53) 

Let us compare this with the sum of the powers of the same lines as 
given by equation (25) : 



P ,_ y ( *> , ^ \ 

Again, index manipulation yields 



(54) 



P ' l ~ £„t 2 (1+1'L) 2 ' (55) 

This series is easily summed by means of cotangent residues (see 
Section 7.4-4 of Ref . 6) to give 

2a 2 CSC 2 (j J 

Pi = jt^-L , (56) 

which is identical to equation (53) . Thus, all lines with the same fre- 
quency, /, where < / < f N , are phased such that their powers add. 
As a result one need not take line degeneracies into special account 
when considering the noise power spectrum. We assume, without proof, 
that this statement is true of sidebands as well as main lines; it is 
elementary that the power in a sine wave is not changed when its 
phase is modulated. 

If L is even there is a line at j^n — In, on the border between the 
Nyquist interval and higher frequencies. If one starts from equation 
(20) rather than equation (23), so that the higher frequencies are 
taken into account, equation (51) with I = L/2 will result. 

For I = V L we get ji = 0, that is, a dc component. Summing up 
these terms of equation (23) , 

00 c\ 

voNL{t) = Yj ~YT sin irl'Ld . (57) 

Starting from equation (49), subtracting the n = term (1/a) from 
both sides, letting a — > 0, and combining terms of +n and — n, gives 

£iba*_E^i for o<#<ar. (58) 
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Using equation (58) in equation (57) gives 

>OXL = |(1 - W.), (59) 

where #1 is defined in equation (52) . Thus, the dc component fluctuates 
as a function of t? x or t? . If it is averaged uniformly over this parameter, 
the mean value is zero and the mean square is a /3L . The latter is the 
sum of the powers of the Z'L-lines. The dc power varies from zero to 
<7 2 /L 2 . Thus, for rational #, the total noise power in the Nyquist interval 
(counting one-half the power at fy) is not always <r 2 /3 but can vary 
from this total by — cr 2 /3L 2 , +2<r 2 /3L 2 . For small # and correspondingly 
large L this variation is not very significant. In any case, as Section III 
explains, the usual AM system suppresses dc at the decoder. 
If the Z'L-lines are modulated, we have 

v N S) = Z 4^ sin tVL\& q + 0(0] (60) 



|'-1 T 



I'L 



= £ [1 - 2A(0], (61) 

where & t (t) is defined by using # + g(t) in equation (52) in place of 
#o . If the excursions of g(t) are significantly greater than 1/L ((g 2 ) » 
1/L 2 , which covers nearly all cases of practical interest) equation (61) 
can be time-averaged uniformly over t?i(0- As stated above, the mean 
square will be <r 2 /3L 2 . That is, for a practical input signal, the power 
in the Z'L-lines is dispersed into sidebands, and the total power in these 
sidebands is equal to that which would be calculated using the formulas 
for irrational #. This argument is used to justify the assumption that, 
except for dc power, the noise spectrum for rational # can be calculated 
as indicated in the text for irrational #. 

There are two cases of rational # which are of special interest. One 
is & = 0, calculated for gaussian input by van de Weg 3 . In this case all 
the even-Z lines are centered at zero frequency and all the odd-Z lines 
at j N . As one can see from Section VI and Figs. 12 and 13, this is a good 
approximation only for a baseband with a width much greater than t?/, . 

The other case of interest is t? = 1. This is equivalent to using the 
even-instant law of equation (8) for all sampling instants, which is 
equivalent to ordinary uniform PCM (with a step size of 2a). Let us 
consider a typical PCM speech system, for which (see Section VI) 

<<7 2 > = <0 2 >-(2vr-8OOHz) 2 (62) 
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and 



/, = 8 kHz. (63) 



Then (Appendix D) 



S » 0.63<<7 2 > } . (64) 

Useful input signals are many steps high in amplitude ((g 2 ) ~2> 1); thus 
S > 1 and the noise spectrum is substantially white. (See Section VI. 
This range of S is permissible for PCM, since slope overload does not 
occur.) 

If # = 1 is inserted into equation (31) the result can be shown to be 
equivalent to that of Schouten and van't Groenewout for a sinusoidal 
input into a PCM coder if one allows for: 12 (t) their nonunity shape 
factor, (m) their particular choice of phase (cp), (Hi) replacing the last 
sine factor in their expression (17) by a cosine, and (iv) multiplying 
their expressions (15), (16), and (17) by 2. 

appendix c 

Rational Input-to-Sampling Frequency Ratio 

If the ratio of / to f 8 is a rational fraction, there exists a least posi- 
tive integer M for which Mf /f s is integral. In this case it is easily 
seen, from equation (29) , that terms for which the values of m differ 
by a multiple of M have the same Nyquist-interval frequency. Sum- 
ming up these equal-frequency terms, we replace equation (29) with 

v.M = E E E 6i E J.+.'jrGrM) exp [i(m + m'M)<p] 

iO^ + k y + ,„;„],}. (65 ) 

One can therefore see that a given Z-group consists of a total of M lines, 
the original and M—l satellites spaced uniformly throughout (—f N , f N ) . 

The sum over m' in equation (65), which is the relative amplitude 
coefficient of a satellite [B m (z, tp, M), where z = ttIA] can be turned 
into a finite sum: 

It is easy to verify that 

jftM***^)' 1 if p = m + m ' M 

= otherwise, (66) 

where m, m', M, and p are integers. 



exp <7rt7t? n + 2wi 
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Thus 



CO 

B m (z,<p,M) = X) «/-+»'* (z) exp [i(m + m'M)<p] 



(67) 



= Z J,®e u 



r i m i 



(2iri n(m — p) 
M 



(68) 



1 — .°° 

= 77 Z Z •A.fc) exp 



tpl^ - 



27m 
M 



(2irinrn\ 



(69) 



The sum over p is given by equation (28) . Thus 

BJ,. ,. M) = i t -P [-in („ - f ) + ^} (70) 

We note the dependence on the phase (<p) of the input signal, which 
indicates that this result could not have been obtained by adding the 
powers of the equal-frequency terms. Indeed, it can be established 
easily from equation (67) that 



-f 

27T J 



B m (z, <p, M) \*d<p= £ J) 



r(*); 



(71) 



that is, the sum of the term powers is given by the true satellite power 
averaged uniformly over <p. 

In order to emphasize this dependence on phase, let us examine the 
highly artificial but simplest nontrivial case, /o = /#• In this case 
M = 2 and each main line has one satellite spaced f N away. Then 



B (z, <p, 2) = B 2 (z, ip, 2) = cos (z sin <p), 



(72) 



and 



B x (z, (p, 2) = i sin (z sin <p). (73) 

For <f = 0, the satellite power is always zero and we get the undis- 
turbed idle-channel-noise spectrum. That this is to be expected can be 
seen from equation (27) where <p = is the condition under which the 
sampling instants fall precisely on the zeroes of the input wave. For 
<p = tt/2, where the sampling instants fall on the crests, the power for 
any given I oscillates between main and satellite as a function of 
amplitude. This result may be compared with the incorrect one ob- 
tained by summing powers: 



^ f*' \ B (z, <p, 2) | 2 d<p = 



1 + Jo(2z) 



(74) 
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and 

£ J' | £,(*, <?, 2) | 2 d<p = l ~ J / 2z) - (75) 



APPENDIX D 



Calculations for Broadband Input 

The autocorrelation function of v{t) [denned in equation (14)] is 
given by 

R(t) m lim ~ f ( £ x n r. 6(t - nr.)) 

5j z m r, 8(/ - mr, + r) ) dt (76) 



2 si'/t. str+Tj/r, 

= lim ^ E Z avs- «[t + (n - m)r.]. (77) 

r-,0,, Zi ng-r/T, mg(-r+T)/T, 

We can replace !T/t, with a positive integer 2V without loss of general- 
ity. Let us concentrate on values of t lying between (k — 1/2) t 8 and 
(fc + 1/2) t 8 where k is an integer. Only terms for which n—m = —k 
fall within this interval. Thus 

1 r 

#(t) = t. lim rrr 2 z n z n+ * S(t — fcr.) 

JV-«oo «*» n --JV 

for (k - |)r. < r ^ (fc + |)r. . (78) 

Defining 

1 r 

(x n x n+k ) m lim ^r= 2 x n x n+k , (79) 

AT-,00 ZiV „=-AT 

and joining together the segments of the function given by equation 
(78), we have 

R(r) = r, £ (x n x n+k ) 6(t - fcr.). (80) 

The Fourier transform of 22 (t) is the noise-power spectral density, 
first given by Bennett (see pp. 460-464 of Ref . 7) : 

W(f) = r. £j <«.«.+*) exp(2irt*/T.). (81) 

It is easy to see that 
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[ fN W(J) df = (x n x n ) m (x 2 ); (82) 

that is, the total noise power in the Nyquist interval is given by the 
mean square of the sequence {x n }. 

Next, let us connect {x^c n+k ) with the input signal. Using equation 

(12) 
(x n x n+k ) - ( 2 £ - "277 

•exp {iri[(l + X)t?„ + (/ + X)n(l - 0) + lk(l - &) + /<7„ +4 + ty.]}/. 

(83) 

We carry the averaging bracket inside the summations and examine the 
various factors of the exponential. Since n and g n are uncorrected, the 
factors containing them can be averaged separately. Let us examine the 
factor 

/ ».(i+X)n(l-<J)\ 

For irrational t? this expression is zero unless I + X = 0, in which case 
its value is one. Thus equation (83) reduces to 

(x n x n+k ) = E i«*"* cl - #, <«P (rtlfo.** - g n ))). (84) 

Notice that (see p. 66 of Ref . 12) 



1*0 7T 



'Z 2 3 



Let us now find the value of the averaging bracket in equation (84) 
for a gaussian input: 

(exp [iril(g n+k - g„)]) 

/SO /•• 

I exp [Tril(g„ +k - g n )]P(g n + k , g„) dg n + k dg„ , (86) 
-co »"-eo 

where P{g„ +k , g„) is the joint probability density of two gaussian 
variates, which is (see Section 18.8-6 of Ref. 6): 

„, . 1 / gl — 2a k g n g n + k + gl +k \ / Q7 x 
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where 

a k = ( - S pf 1 , (88) 

1 w 

(g„g n+k ) = lim — : ]T 0"0«+* , (89) 

and 

(g 2 ) - Cm.)- (90) 

Combining equations (86) and (87) gives 

(exp bril(g n+k - g n )]) = exp [-* 2 l\g 2 )(\ - 0*)], (91) 

a result first obtained by Rice. 13 Substituting equation (91) into equa- 
tion (84) , and the result into equation (81) , gives 



w(j) « E E _*? 



. 2 

1*0 fc--oo 7T 



•exp [-ir 2 ZV>(l - «■) + 2^(/r. + ' (1 2 d) ) 



(92) 



This result, with # = 0, was given by van de Weg. 3 He also used as 
an input a flat signal, band-limited to ( — / m , / m ), for which 

sin (2irkf m T.) fQV . 

a " = 2*kf m T. ' (93) 

and inserted 

l-*«S*^. (94) 

This approximation is made possible by observing that the real ex- 
ponential factor in equation (92) is appreciable only for small values 
of the exponent. Thus, if one ignores the region of low signal-to-noise 
ratios (that is, small (g 2 )), 1 — a k need only be accurately approxi- 
mated for small values, (g 2 ) > 0.1 is high enough for the approximation 
to be good for most purposes, and appears to cover nearly all cases of 
practical interest. 

It is not necessary for the input spectrum to be flat. We take a 
spectrum, £/(/), even in / and confined to the Nyquist interval. Ap- 
pendix E shows that (g„g n+k ) is given by R g {kT a ), the autocorrelation 
function of g{t). This autocorrelation function is the Fourier trans- 
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form of the spectral density. 

/oo 
U(f) exp (2wikf T ,) df (95) 

-00 

and [using the evenness of U{f) ] 

(g 2 )(l - a k ) = f U(f)(l - cos 2wkfT.) df. (96) 

Using the reasoning given in the previous paragraph, and specifying 
that £/(/) be a smooth function of frequency (free of strong narrow- 
band components which could make 1 — a k tt for isolated high values 
of k), gives 

<0 2 >(1 - a k ) w £ r (2rf) 2 U(j) df, (97) 

") I •> — oo 

It is well known that the integral in equation (97) gives the mean 
square of the time derivative of g(=g). Thus 

where S is the rms time slope of the input normalized to the maximum 
average slope of the coder (o-/ g ) . Inserting equation (98) into equation 
(92) gives 

W(f) - E t T -4 «P \~ ( ^f- + Wb(fr. + !&=£)] (99) 

which is equation (33) . 

Making use of the Fourier-series expansion of a picket fence of 
gaussians, 

exp [-a (a; - p.r ) ] = 2^ 1 TT ex P ~l ) H . 

p--oo t— oo I a | #o . Vxav £o J 

(100) 

we can rewrite equation (99) as 

WW = g f; ^fg exp [-^ ( /r . + SLrii + P J] 

(101) 
which is equation (34) . 
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Computationally more convenient versions of equations (99) and 
(101) are, in one-sided form, 

p<f) = ^£ 



' I 2^ 72 « + Z^ ex P I n — ) cos7rtA;(l — #) cos27tA;jt, r , 

(102) 

and 

+ exp [_^( /r . + p _KL^)°]}). (103) 

In equation (102), 1/2 %{l/l 2 ) is left in that form in order that the 
power density can be calculated separately for each I. 



APPENDIX E 



Autocorrelation — Function and Its Samples 

In the absence of aliasing, the autocorrelation coefficients of a se- 
quence of samples of a function are equal to the appropriate samples 
of the autocorrelation of the function : 



1 r 

(g n g n+ k) = lim TTft £ g n g n +k (104) 

N-<n «» n N 

= lim 7yT T / Z g(nr.)g(nr. + ftr.) «(/ - nr.) d/ (105) 

jV-,00 ZiV J-Nt, n--oo 

= lim ^ ( ' pflM* + kr.) £ «(/ - rcr.) d* (106) 

= lim — p_ ( ' ff (0^ + At.) £ exp (2rtp/.*) * (107) 

= lim ~r ( rfDrf' + fcr.) <ft (108) 

s fl,(fc r .) (109) 

where the transition from equation (107) to equation (108) is made by 
assuming that g(t) is confined to the Nyquist interval. For any given 
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value of p i£ 0, equation (107) can be regarded as the correlation func- 
tion of g(t) and g(t) exp (2vipf,t). The latter represents a carrier wave at 
/ = pf. amplitude-modulated by g(t). None of the sidebands resulting 
from this modulation overlap g(t) in frequency if g(t) is confined to the 
Nyquist interval. It is well known that two signals are uncorrelated if 
their frequency bands do not overlap (but not, in general, otherwise) . 

Dividing equation (109) by (g 2 ) = R„(0) gives the lemma in nor- 
malized form. The procedure given here is a slight generalization of one 
given by Bennett for k = (see pp. 468-469 of Ref. 5). 
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